ALTERNATIVE PROOF OF A TECHNICAL LEMMA FOR 
THE ANALYSIS OF RANDOM K-XORSAT 



GREGORY B. SORKIN 

Abstract. Pittel and Sorkin's "The Satisfiability Threshold for fc-XORSAT" 
proves a lemma governing a certain function of several variables, from 
this deriving a corollary that is their main result. This note gives an 
alternative proof. 



1. Notation and fact to be proved 

Pittel and Sorkin's "The Satisfiability Threshold for fc-XORSAT" includes 
Lemma 4, governing a certain function of several variables, which it uses to 
establish Corollary 7, which is essentially their main result. This note's 
Lemma [1] and Corollary [2] are "drop-in replacements" for those two results. 
Its purpose is to offer an alternative to Lemma 4 (page 11) of |PiSo2012] 
and its proof (pages 14-21 and 24-26). 

The proof here borrows liberally from that in [PiSo2012] and a proof 
sketch suggested earlier by Paul Balister [B a2012| . 

The context is a random XORSAT formula with n variables, m clauses, 
and k variables per clause, where m = cn, c £ (2/k, 1) and k > 3 are fixed, 
n — > oo, and all O(-) expressions are with respect to this limit. Also, we 
have a function / arising from a truncated Poisson distribution 



X. 



and we define A as the unique root of 

xf'(x) km 



kc: 



f(x) n 

all details are in [PiSo2012j . Our starting point is inequality jPiSo2012l 
eq (18)], governing an expression of interest that we will not define here: 



«M8J< <i)^(7)(£)V 



1 f f(z 2 ) + e Z2 (coshz 1 - 1) . 
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where £ G {2, . . . , m}. Observe that 

-/ n , z 2 f u i\ f( z l+ z 2) + J(Z2 ~ Zi) 

f{Z2) + e (cosh z\ - 1) = - • 

Using the Stirling formula for factorials, recalling from [PiSo2012j that m = 
cn with c G (2/k,l), and introducing a = £/m, a = 1 — a, Z\ = Ci^, 
-22 = C2A, and C = (Ci ? C2 ) 7 we rewrite (Q]) as 

(2) E[yW„] <0(1) ^Jexp[nfl- fc (a,C;c)], VC>0, 
where we have used yk = 0(1), defined 

(3) H}.(a, C;c) = cH(a) — cka\n.{Qi / a) — cka Infa/a) 

, , /(A(C2 + Ci)) + /(A(C2-Ci)) 
2/(A) 

and where H{a) is the usual entropy function 

if (a) := —a In a — (1 — a) ln(l — a). 

The main purpose of this note is to prove the following lemma, which we 
will do in the next section. 

Lemma 1. For all k > 4, letting 

(4) a k = ek~ k ^ k - 2 \ 
for all c G (2/k, 1), there exist e, Co > 0, such that 

(5) (Vq G (0, a k ] ) (3C) : H k (a, C; c) < (ca)(| - 1) In(a/a fc ) and C2 > Co 

(6) (Va G [Q fc /3, 1) ) (3C) : flfc(a, C; c) < -e and C2 > Co- 

This will yield the following corollary, very similar to [Pi So2012l Corollary 
7] and establishing Pittel and Sorkin's main result. 

Corollary 2. For all k > 4 and all c G (2/k, 1), 

m 

E[y m , n ]=^EK)]=0(m"M). 

In the paper's context, the Corollary says that the expected number of 
nonempty critical row sets tends to 0, by the first moment method so does 
the probability of any such set, and thus the linear system is solvable, asymp- 
totically almost surely. 

Proof of Corollary. Letting l k = akm = 0(n), for t < £k/2, recalling that 
acn = am = £, (j2]) and ([5]) give 

E[rW n ] =0(l)exp[(!-l)^n(£/4)]. 
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By convexity of £ln(£/4), for I £ [2,4/2], 

£ln(£/£ k ) < 21n(2/4) + 2 ((4/2) ln(l/2) - 21n(2/4)) 

= 21n(2/4) + (i-2)(-ln2 + o(l)), 
using that 4 = &(n). Thus, 

E[yW n ] < 0(1) exp ((I - l)2[ln(2/4) - 0.6(1 - 2)]) 
= 0(1) m" (fc - 2) exp(-0.6(^ - 2)), 
where we have hidden a (2/ctk) k ~ 2 in the 0(1). Then, 

L(a fe /2)mJ 

E IE[^i]=0(l)(m-( fc - 2 )). 

For * > (a fe /2)m, by ©, 

E[yW n ] =0(l)exp(-en), 

giving 

m 

E E K?n] =exp(-0(n)). 

£=rO fe /2)ml 

Adding the two partial sums yields Corollary [2j □ 

2. Proof of Lemma [TJ 

Motivation for the values of £i and £2 used to control Hk(a, c) is given 
in |PiSo2012] . Lemma Q] is proved by Claims El IH [5] and El respectively 
treating a in the four ranges (0,0.99a fc ], [0.99a fc , 0.2743], (0.2743,1/2], and 
(1/2, 1). Recall the notation a = 1 — a and £ = (£1, (2)- 

Claim 3. For all k > 3 and all c £ (2/k, 1), for all a G (0, a&), taking 

(7) Ci = (cAT^a 1 / 2 , C2 = a, 

yields Hk(a,£;c) < (ca)(| — l)ln(a/«fe). 

A /so, /or all k > 3 and all c S (2/fc, 1), i/tere exists e > suc/i i/iai for 
all a £ [afc/3, 0.99«fc], the same £ yields Hy.(a,Q\c) < —e with (2 = @(1)- 

Proof. The issue in this range of a is to control the final logarithmic term of 
Hf-(a, C', c) when the two summands within the logarithm are nearly equal. 
Note that ln/(x) is concave on either side of 0, as 

Since ^ ln/(A(l + A)) = ^jff > if A and A(l + A) are on the same side of 
(if 1 + A > 0) then concavity gives ln/(A(l + A)) < In /(A) + A^y- Or, 
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with C=l + A, if C > then 

(8) --— < exp I (C - 1) , A > 1 = exp ((C - l)cfe) , 

recalling that A/'(A)//(A) = ck. It is easily checked that (jl]) gives a& < 0.2 
for C2 > 0.8 and © then gives Ci < 0.4, so C2 + Ci > and C2 — Ci > 0- 
Thus for the final term of -fffc(a, £; c), we have 

, /(A(C2 + Ci)) + /(A(C2-Ci)) 
111 27(A) 

CTpCcfc^ + Ci-l)) exp(cfc(C 2 - Ci - 1)) 
2 2 

exp(cA;(j) + exp(— cfc£i] 



In exp(cA;(C2 - 1)) 



2 

= cfe(C2 — 1) + lncosh(cA;Ci) 

< cA;(C2 - 1) + (ckdf/2, 

using the general fact that In cosh x < x 2 /2. Now also using —a In a < a for 
all a € (0,1), from ((ZD, 

i?fc(a, C; c) < — ca In a + ca — cka ln(cfca) -1 / 2 — + ck(—a) + Vcka /2 

< ca[(| - 1) In a + (1 - |) + ±fcln(cfc)] 
= (cQ)(|-l)ln[ai(cA;) fc/(fc - 2) ]. 

Pessimistically taking c = 1 within the logarithm and recalling 

(9) H k (a, C; c) < («*)(§ - 1) ln(a/a fc ). 

This proves the first part of the claim. 

Clearly, for all a G (0, «&) the logarithm in Q is negative, so over 
any properly contained sub-interval, Hfc(a, £;c) is bounded below 0, i.e., 
/ifc(a;c) < — e for some e > 0. From © it is also immediate that C2 is 
bounded away from 0. This establishes the second part of the claim. □ 

Claim 4. For all k > 4 and all c € (2/fc, 1), £/iere exists e > swc/i £/ia£ /or 
a// a E (0.99afc, 0.2743], taking (1 = a, (2 = ol yields Hk(a,C',c) < — £ and 

C 2 = e(i). 

Proof. That £2 = ©(f) is immediate. Now, 
ff fc (a, C; c) = cff (a) + In U + | /(A( ^ ~ 2a)) ) 

< cff (a) + In (i + i exp(-2cfca)) (by © and 1 - 2a > 0) 

(10) < c[H{a) + In (i + i exp(— 2ka))], 

the last step following from concavity of ln(^ + i exp(— 2cka)) =: g(c) as a 
function of c. The application of concavity is simply g(c) < (1 — c)g(0) + 
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cg(l) = cg(l) using g(0) = 0. The proof of concavity is that, with L = 2ka, 

exp(— cL) ( exp(— cL) 



fg _ 2 

dc 2 



1 + exp(— cL) \ 1 + exp(— cL) 



> 0, 



the inequality following from negativity of the exponent's argument, so that 
the fraction lies between and 1/2. 
From (|10p . it suffices to prove that 

Sfc(a) := H(a) + ln(| + i exp(— 2fca)) 

is negative for a G [0.99afc, 0.2743]. For a fixed k this can be confirmed by 
interval arithmetic. It suffices to cover the interval with sub-intervals [a' , a"] 
for each of which H(a") + ln(| + ^exp(— 2fca')) < 0: the arguments a" 
and a' pessimistically maximize the first and second terms independently. 
For numerical security we will choose intervals establishing that Sk(ct) < 
-0.0001. 

For k = 4, 0.1681 < 0.99a fc and 49 intervals suffice to cover [0.1681, 0.2743] 
and show that s k (a) < -0.0001. For k = 5, 0.1839 < 0.99a fc , and 2 inter- 
vals suffice: [0.1839,0.2291] and [0.2291,0.2743]. For k = 6 a single interval 
would suffice. However, noting that -r < 0.99afc, we instead establish that 
Sk{at) < —0.0001 over the larger interval [jr, 0.2743]; for this, the two inter- 
vals [0.1666,0.2204], [0.2204,0.2743] suffice. 

For k > 6, \ < 0.99a fc . (Check that Ink - ^ ln(0.99e) < at k = 6 and 
has negative derivative for k > 6.) We now prove by induction on k that 
Sfe(a) < over a € [^,0.2743], for k > 6. We have already established the 
base case. Since Sfc(a) is monotone decreasing in k, Sk(a) < Sfc_i(a) < for 
a G [-£7^-, 0.2743], by the inductive hypothesis, so we need only show that 
s k (a) < for a G H,^]- Over this interval, H(a) < H{^ 1 ) < H(\) < 
0.451, while the other term of s^(a) is decreasing in ka, and ka > 1, so 
ln(i + i exp(— 2ka)) < ln(i + ^ exp(— 2)) < —0.566; summing the two terms 
proves that Sk(a) < 0. □ 

Claim 5. For all k > 4 and all c G (2/k, 1), there exists e > such that 
for all a G (0.2743, 1/2], taking = a, £2 = & yields Hi : (a,C;c) < —e and 
C2 = &(!)■ 

Proof. Again, Q2 = ©(1) is immediate. In this case, with a relatively close 
to 1/2, the key is to govern the term /((l — 2a)X)/ f{\). Motivated by the 
small- A asymptotic equality /(A) ~ ^A 2 , we will show that 

where we may choose q = 1 for any x G (0, 1) and A > 0, and smaller values 
of q for restricted ranges of x and A. 
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To establish this, we first show that R(X, x) is increasing with x. 

-f ln(R(X, x)) = _ £ = 1 (fi/(s) _ 2/(g)) 

ax /(Ax) x x/(s) 

where we define s := Ax. Using e s > 1 + s, 

*/'(«) - 2f(s) = s(e s - 1) - 2(e s - a - 1) 

= (s - 2)e s + s + 2 > (s - 2)(1 + s) + s + 2 = s 2 > 0, 

establishing that ^ ln(i?(A, x)) > and thus that R(X, x) is increasing in x. 
We next show that R(X, x) is decreasing with A. 

and we wish to show that this is < 0. It is easy to check that it is equal to 
in the limit x — > 1, so it suffices to check that it is increasing with respect 
to x for x > 0. Since the first term is constant and A is constant, this is 
equivalent to Ax/'(Ax)//(Ax) being increasing with respect to Ax, an easy 
fact given as |PiSo2012l Note 1]. 

We have now established that if /(AoXo)/(xq/(Ao)) = q, then for all A > 
Ao and all x £ (0,xo], f(Xx)/f(X) < qx 2 . In particular, /(Ax)//(A) < x 2 , 
for all A > and all x € (0, 1], because the limit Ao — > 0, xo — > 1 gives q = 1. 

We also use that 

H{1 - x) < In 



2x 2 + 1 



This can be verified by checking that — x) — In y 2 x%+i ) anc ^ ^ s ^ rs ^ 

derivative are both at x = 0, while the second derivative is — p~f^jp — 

+ T+b<° fOT * e (O'VZ). 
Recalling that Claim [J] covered a € (l/k,ao] with ao = 0.2743, we need 
only be concerned with x 6 (0,xo), xo = ^ — «o — 0.2257. We treat this 
with two cases. 

For A > A = 2.7694 and x G (0,x ), f(2Xx)/f(X) < 0.4999. Thus 
flfc(a, C; c) = ci? (i - x) + In (| + | • ^ 

< ln (^i)+ lll (l + r '«( & ) 2 ) 



= In 
< 0. 



1.9996x 2 + 1 
2x 2 + 1 
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For A < Ao, we have ck < 3.3992, so using ck/k = c and k > 4, 

3 3992 

H k (a, C; c) < ~^H{\ - x) + In (± + ± ■ 1 • (2x) 2 ) 
3.3992 / 2 \ /4x 2 + l 

< for x G [0,xo]. 

The final statement can be checked by verifying that the previous expression 
has nonnegative derivative and, at x = xq, is < —0.0011. □ 

Claim 6. For all k > 4 and all c G (2/fc, 1), there exists e > suc/i f/mi /or 
a// a G (1/2, 1] t/iene exists C, with Q2 = ©(1)> for which iifc(a, Ci c ) < ~ e - 

Proof. Since /(x) > /(— x) for x > 0, and A = X(kc) > 0, 

ff fc (l,(l,0);c)=ln /(A) 2 +^- A) <0. 

By continuity of Hk(a, (1 — (2, C2); c) in a and (2, for 5 = 5(c, k) > suffi- 
ciently small, 

sup Hk(a, (1 — 0", (5); c) < 0. 
ae[i-<5,i] 

So, for a > 1 — 5, taking £ = (Ci, C2) = (1 — S, 5) yields the claim. 

For a G (^,1 — 6], let £(a; c) denote the values given by Claims [3HS1 and 
here (noting the coordinate swap), set (C2? Ci ) := C(^; c )- Immediately, 

fffc(a,(Ci,C2);c) < H k {\ -a,(C 2 ,Ci);c) =fl" fc (a,C;c) <0, 

the first inequality by inspection of the symmetries of ([3]) and £2 < Ci 
(checking that in Claims [3HH1 £1 < £2), and the second inequality immediate 
from Claims (3HSJ Finally, C2 = ©(1) because C2 here for a G — 5] is 
equal to an earlier claim's Q\ for a G [5, i], variously of order ©(a 1 / 2 ) or 
©(a), and in either case bounded away from since a > 5. □ 

This completes the proof of Lemma Q] and thus this note. 
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